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A short note on estimation of WCRE and WCE 
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Abstract 


In this note the author uses order statistics to estimate WCRE and WCE in terms of 
empirical and survival functions. An example in both cases normal and exponential WFs is 
analyzed. 
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1 Introduction 

Let A be a non-negative absolutely continuous random variable (RV) describing a component 
failure time, with the probability density function (PDF), f(x), the cumulative distribution 
function (CDF), F(x) = P(X < x ), and the survival function (SF), F(x) = P(X > x). 

Following [6j for given function x € R i —> ip(x) > 0, and the PDF /, the weighted cumidative 
residual entropy (WCRE) of X (or F) with weight function (WF) ip is defined by 



( 1 . 1 ) 


A standard agreement 0 = 0- log 0 = 0- log oo is adopted. Given the CDF, x € M + >->• F(x) € 
[0,1], with WF ip, the weighted cumulative entropy (WCE) of a RV X is presented by 



( 1 . 2 ) 


Note that in particular tp(x) = x the WCRE and WCE in (11.11) and (11.21) turn (8) and (9) in 
[3j. Evidentally for <p = 1, the WCRE and WCE take the forms CRE and CE, cf. [2]. 

Passing to Kullback-Leibler divergence D(.||.) and CRE £(.), it’s worthwhile to note that 


£™(F) = —D(ipF\\ip) = £(cpF) + D(<pF\\F). 


(1.3) 
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Remark 1.1 (a) Suppose an RV X follows exponential distribution with mean Then 


A 


1 , 


S™(F) = -E z [p(Z)\ 


1 


where RV Z has Gamma distribution with shape parameter 2 and scale Note that for any 


real number £ and particular form of ip(x) = e the WORE becomes the Fourier transform 


A 


of Gamma’s PDF. Moreover, if p(x) = e 


itx ( g —s x 


t € R, then £^{F) takes the Gammas’s 


characteristic function (Laplace transform). Also assume the case p is the polynomial function 
of x, x> 0, ai > 0, i = 0.. .n: 


<p{x) = a n x n + a n -1 x n 1 H - b a\ x + a 0 . 

Observe that the WORE reads 

£J(F) = r(i + 2) = (i + l)!. 

»=0 

(b) The weighted entropy defined in J2J/, h™, for the equilibrium RV, X e , associated to a non¬ 
negative RV X with SF F relates to the WORE by 

E[X\h”(X e )=£^(F) + logE[X] [ tp(xjF(x)dx. 

J R+ 

The reader would be addressed to [6j for numerous properties and motivations of WORE and 
WCE. Also refer to m, 0 for more details regarding the weighted entropies. 

The main aim of this work is to represent an empirical estimator for WORE and WCE, 
following analogue arguments in 0, 0. 


2 Main results 


The paper statistically focuses on the estimation of WORE and WCE with general WF tp by 
using the order statistics. Here and below F n and F stand the empirical distribution and survival 
function of random sample X] , W),..., X n at point x: 

1 n ~ 

F n (x) = - V 1 {Xi < x} , F n (x) = 1 - F n (x), 

n z —^ 

i=i 

where 1{W < x} is the indicator function of the event {X < x}. 


Definition 2.1 Let X\, X 2 , ■ ■., X n be a random sample drawn from a population with distri¬ 
bution function F. Again set p(x) as WF, according to the definition of WORE and WCE in 
enp and m, the empirical WORE and empirical WCE respectively are defined by 


£™(F n ) 



p(x)F(x) log F(x)dx, 
p(x)F(x) log F(x)dx. 


( 2 . 1 ) 
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Paying homage to the Theorem 9 in [4], with similar methodology the following assertion holds 
true, omitting the proof. 


Theorem 2.1 Let X be a non-negative RV in L p . Given p > 1 suppose for given 0 < a < oo 
the WF ip obeys 


f 


cp(x)dx < oo and / (p(x)x p dx < oo. 


( 2 . 2 ) 


'0 J a 

Then the empirical WORE convergens to the WORE of X, that is : 


C(F n )^OF) o.s. 


Next, consider the order statistics of random sample, denote by Jn),X{ 2 ),... ,Xr n \, indeed on 
the other hand £™(F n ) renders the empirical quantity as 


-w - ^ f x (*+ 1) 

£ Z(Fn) = -22 f(.x)F n (x) log F n (x)dx. 

Jx a) 


(2.3) 


Further, set 


C i * 


px 

i(i/>(xr i+ and ip(x) = cp(t)dt. 

Jo 


Taking into account F n (x ) = —, Xu\ < x < Xo +1 ), i = 1,... ,n — 1, the Eqn (|2.3D becomes 


n 


n —1 


f J( F ") = (VK^+p) 

2=1 ' 

^ 71—1 

=-VfcPogi-logn]. 

n z ' 


2=1 


In addition following more straightforward computation yields 


71—1 

£ 

2=1 


71—1 2 


EC i = (^( x (<+i)) -V’teii) 

2=1 jfe=l ' 

71—1 71 — 1 ✓ 

- EE ^(*(*+1)) -V’O(i) 

/c = l 2=/c ' 

= = n(^f (»(„)) - ip 


where tp = ^ Consequently, 


2=1 


71—1 


O-^n) = (V’^h) -V’) log n — - ^(ilogi. 


(2.4) 


2=1 
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Now set Ti = (n — i) (VK^O+i)) — VKsimilarly it is plain that 

^ n—1 

£^{Fn) = (V’ — V’( x (i))) log n ~ -^2nlog(n - i). (2.5) 

2=1 

The note is concluded by giving an example in order to discuss the represented estimation 
for WORE and WCE above. In fact in Example 12.11 two Normal and Exponential WFs are 
considered. The observations from the simulations are coincide with analytical computation 
here and in [6]. 




Figure 1.1 Figure 1.2 


Empirical WORE and WCE for the data of Example 12.11 with Normal WF: Longdash (<j = 0.5), point 
(a = 1) and Solid (a = 2). 

Example 2.1 For Given set of 50 Sample lifetime generated from exponential distributions 
with mean 2: 
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(I) Normal WF: According to the upcoming sample, assume the WF 

ip(x) = exp ( — x 2 /2a 2 ). 

The graphs in Figure 1.1, 1.2 present the empirical WORE and WCE for the given data in partic¬ 
ular value of a = 0.5, 1, 2. These simulations show that both WORE and WCE are increasing 
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Figure II.1 


Figure II.2 


Empirical WCRE and WCE for the data of Example 12. 1 1 with exponential WF: Longdasli (t = —1), point 
(t = —0.2) and Solid (t = —0.0001). 

in a , however this is what we were expecting from the analytical calculations. In addition, for 
biggest <7 = 2, same as CRE and CE, when the number of sample order data, n, is increasing 
the both curves WCRE and WCE are ascending as well, whereas for small value of a this is 
violated. For instant for a = 0.5, WCRE(35) = 0.1872 and WCRE( 40) = 0.1847 or when 
<7 = 1, WCE{ 35) = 0.3299 and WCE{ 40) = 0.3270. 

Here WCRE(n ) and WCE{n) are the amount of WCRE and WCE in n respectively. 

(II) Exponential WF: Suppose that tp(x ) = exp (tx). To satisfy the condition (12.21) in 
Theorem 12.11 constant t should be considered non-positive. Observe the Figure II.1, II.2 for 
the given sample data. The graphs represents the WCRE and WCE for different values of 
t = —1, —0.2, —0.0001. Here also the WCRE and WCE are increasing when t is increasing. 
Although in spite of Normal WF case, for each value of t the WCRE and WCE increase singly. 
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